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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings of claims in the 
application. 

Listing of Claims: 

1 . (Previously Presented) A method of semantically classifying an image, the method 
comprising: 

forming a group of hierarchical layered blocks from the image, each block within the 
group being only partially coextensive with the other blocks of the group; 

determining a posterior estimate of class membership of the group of hierarchical 
layered blocks, the estimate being based upon class likelihoods of the hierarchical layered 
blocks in the group, such likelihood being conditioned on data extracted from hierarchical 
layered blocks in the group; 

semantically classifying a portion of such image based upon the posterior estimate of 
class membership conditioned on the data extracted from the group of hierarchical layered 
blocks local to such portion. 

2. (Original) A method as recited in claim 1 , wherein the determining comprises: 
determining an estimated class likelihood of each block in the group of hierarchical 

layered blocks; 

combining the estimated class likelihoods of hierarchical layered blocks in the group 
into a posterior estimate of semantic class membership. 

3. (Cancelled) 

4. (Cancelled) 



Page 2 of 8 



Microsoft Corporation 
MS 1 58275.01 



PATENT 



5. (Original) A method as recited in claim 1, wherein the determining comprises 
extracting low-level features from blocks. 

6. (Original) A method as recited in claim 5, wherein the low-level features comprise 
color and textures. 

7. (Original) A method as recited in claim 6, wherein the extracting extracts color low- 
level features by an Ohta decomposition. 

8. (Original) A method as recited in claim 6, wherein the extracting extracts texture 
low-level features by a complex wavelet transform. 

9. (Original) A method as recited in claim 1, wherein the class likelihoods are 
estimated in one-dimensional space. 

10. (Original) A method as recited in claim 1, wherein a classification that results from 
the semantically classifying step is binary. 

1 1 . (Original) A method as recited in claim 1 , wherein a classification that results from 
the semantically classifying step is selected from a group consisting of these binary sets: 

sky or not-sky; 
grass or not-grass; 
natural or man-made; 
inside or outside; 
hair or not-hair; 
face or not-face. 
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12. (Original) An image retrieval method comprising: 

a semantic image classification method as recited in claim 1 ; 

searching for images matching a given query in an image library containing images 
having portions thereof classified using the semantic image classification method. 

13. (Original) A computer-readable medium having computer-executable instructions 
that, when executed by a computer, performs the method as recited in claim 1 . 

14. (Previously Presented) A semantic image classification system, comprising: 

a block analyzer configured to extract low-level features of blocks of an image and 
estimate class likelihoods for each block, a class being a discriminating semantic classification 
and a block being a portion of the image; 

a combiner configured to generate a posterior estimate of class membership based on 
combining estimated class likelihoods of hierarchical sets of blocks, a hierarchical set of blocks 
being a hierarchical organized and associated blocks that are only partially coextensive with 
one another; 

an image classifier configured to determine and classify one of multiple discriminating 
semantic classifications to localized portions of the image based upon the posterior estimate of 
class membership of blocks comprising such portions. 

15. (Original) A system as recited in claim 14 further comprising a hierarchy definer 
configured to subdivide the image into multiple hierarchical sets of blocks, each successively 
lower layer of a hierarchical set of blocks comprising one or more blocks which are smaller than 
and at least partially coextensive with one or more blocks in a layer immediately above. 

16. (Original) A system as recited in claim 14, wherein the low-level features comprise 
color and textures. 
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1 7. (Original) A system as recited in claim 1 6, wherein the block analyzer extracts color 
low-level features by an Ohta decomposition. 

18. (Original) A system as recited in claim 16, wherein the block analyzer extracts 
texture low-level features by a complex wavelet transform. 

19. (Original) A system as recited in claim 14, wherein the class likelihoods are 
estimated in one-dimensional space. 

20. (Original) A system as recited in claim 14, wherein the discriminating semantic 
classifications are selected from a group consisting of these binary sets: 

sky or not-sky; 
grass or not-grass; 
natural or man-made; 
inside or outside; 
hair or not-hair; 
face or not-face. 

21 . (Original) An image retrieval system comprising: 

a semantic image classification system as recited in claim 14; 

a semantic image querier configured to search for images matching a given query in an 
image library containing images having portions thereof classified using the semantic image 
classification system. 

22. (Original) A computer-readable medium having stored thereon a data structure, 
comprising an image library containing images having portions thereof classified using a 
semantic image classification system as recited in claim 14. 
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23. (Canceled) 

24. (Canceled) 

25. - 28. (Canceled) 
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